Back
A review of Stochastic Approximation and the Robbins-Monro algorithm, detailing the evolution, convergence properties, and sampling differences of SGD.
stochastic approximation
sgd
robbins-monro
optimization
study notes